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1.  INTRODUCTION 


This  contract  covered  the  period  April  15, 1991  through  April  14, 1994.  The  participating  person¬ 
nel  included  two  faculty  members  and  nine  Ph.D.  students.  The  research  carried  out  under  this 
contract  involved  both  work  on  simulation  methodology  and  stochastic  models/processes.  The 
simulation  work  involved  the  use  of  simulation  to  carry  out  stochastic  system  optimization,  a  vari¬ 
ety  of  variance  reduction  ideas  to  improve  simulation  efficiency,  and  methods  for  improving  output 
analysis  for  a  single  stochastic  process.  Stochastic  models  studied  involved  a  network  of  water 
reservoirs,  the  general  single-server  queue,  and  a  financial  model  for  trading  securities.  Stochastic 
processes  studied  were  cumulative  processes,  counting  processes,  and  sampling  of  a  general 
stochastic  press. 


2.  DESCRIPTION  OF  RESEARCH 

Our  work  on  simulation  methodology  begins  with  the  formulation  of  a  model  as  a  stochastic 
process.  We  then  use  the  structure  of  the  stochastic  process  to  develop  methods  for  analyzing  the 
output  of  the  simulation.  Diagram  1  is  a  block  diagram  which  details  our  approach  to  system  simu¬ 
lation.  The  performance  evaluation  and  reliability  analysis  of  complex  engineering  systems  re¬ 
quires  an  ability  to  analyze  mathematical  models  of  these  systems.  Large-scale  stochastic  models 
are  required  to  handle  various  uncertainties  present  in  these  systems.  Unfortunately,  the  complex¬ 
ity  of  most  stochastic  models  of  real  systems  is  well  beyond  our  ability  to  apply  classical  mathe¬ 
matical  analysis.  Computer  simulation  of  stochastic  systems  has  become  one  of  the  principal 
alternatives  to  classical  analysis.  The  main  thrust  of  our  research  is  improving  the  efficiency  of 
simulation  methods  and  extending  their  applicability  to  a  wider  class  of  stochastic  systems.  We 
also  carry  out  research  on  a  variety  of  stochastic  models  with  the  aim  of  obtaining  closed  form 
solutions  or  approximations. 

The  recent  topics  being  pursued  in  this  project  fall  into  four  main  categories:  importance  sampling 
for  rare  events,  diffusion  approximations  for  complex  stochastic  models,  Monte  Carlo  evaluation 
of  integrals,  and  stochastic  optimization.  In  all  these  categories  our  approach  is  to  use  the  detailed 
stochastic  structure  of  the  system  under  study  to  obtain  more  refined  results  than  could  be  achieved 
using  a  “black  box”  approach. 

An  increasing  number  of  capital-intensive  technologies  are  intended  to  offer  very  high  standards  of 
reliability  and/or  availability  (e.g.,  air  traffic  control  systems,  communications  networks,  airline 
reservation  systems,  manufacturing  lines).  Rare  event  simulation  arises  when  studying  these 
highly  reliable  systems  that  are  designed  to  rarely  fail.  Naive  simulation  of  such  systems  may  re¬ 
quire  enormous  amounts  of  computer  time.  Our  approach  is  to  use  importance  sampling  in  which 
the  system  is  forced  to  fail  more  frequently  along  a  path  suggested  by  the  mathematical  theory  of 
large  deviations.  The  final  computation  must  be  adjusted  by  the  likelihood  ratio  in  order  to  estimate 
the  original  system  reliability.  Steady-state  performance  measures  for  highly  dependable  systems 
(such  as  fault-tolerant  computer  systems)  are  estimated  by  simulations  involving  rare  events. 
Earlier  work  dealt  with  Markovian  systems  that  could  be  formulated  as  regenerative  process.  Our 
current  work  assumes  that  repair  and  failure  times  are  non-exponential  and  this  leads  to  non- 
Markovian  systems  for  which  the  regenerative  structure  is  lost.  A  new  approach  has  been  devel¬ 
oped  using  importance  sampling  applied  to  a  sequence  of  cycles  which  are  no  longer  independent, 
identically  distributed  as  in  the  regenerative  case.  Experimental  results  show  that  the  method  is  ef¬ 
fective  in  practice.  Gradient  estimation  is  required  when  optimization  of  steady-state  performance 
measure  is  being  carried  out  with  respect  to  a  vector  of  design  parameters.  Conditions  have  been 
developed  under  which  the  likelihood  ratio  methods  and  infinitesimal  perturbation  analysis 
techniques  are  valid. 


Complex  stochastic  models  often  defy  efforts  to  obtain  closed  form  solutions.  Sometimes  it  is 
possible  to  construct  a  sequence  of  such  models  indexed  by  a  physical  parameter  and  to  prove  a 
limit  theorem  for  the  sequence  as  the  parameter  approaches  a  limit.  The  idea  is  to  then  use  the  limit 
process  so  obtained  to  compute  approximations  for  the  original  node.  This  approach  has  been 
used  in  two  recent  papers  devoted  to  complex  repair  systems  and  to  networks  of  water  reservoirs. 
In  both  cases  the  limit  process  is  a  multi-dimensional  Gaussian  diffusion  process.  For  the  complex 
repair  system  a  technique  was  developed  to  analytically  gauge  the  goodness  of  the  diffusion 
approximation.  In  most  cases  the  approximation  was  quite  good. 

For  a  network  of  continuous  time  reservoirs  with  power  law  release  rules,  convergence  of  a  sys¬ 
tem  of  processes  to  a  multi-dimensional  Gaussian  diffusion  process  is  established.  Simulations  of 
the  original  watershed  model  were  carried  out  to  validate  the  use  of  the  diffusion  approximations. 
Conditions  are  developed  for  the  steady-state  waiting  time  tail  probabilities  in  a  single-serve  queue 
to  be  asymptotically  exponential.  These  conditions  cover  the  case  of  multiple  independent  sources 
which  arise  in  the  design  and  control  of  emerging  high-speed  communication  networks. 

Monte  Carlo  simulation  strategies  are  commonly  used  to  numerically  evaluate  high-dimensional 
multiple  integrals.  The  associated  estimators  have  convergence  rates  which  are  typically  rrm, 
where  n  is  the  number  of  function  evaluations  made,  and  are  independent  of  the  dimension  d  of  the 
integral.  Standard  deterministic  integration  schemes  often  have  rates  of  convergence  of  the  order 
n*1/d.  Monte  Carlo  methods  construct  estimators  involving  sample  means  of  function  evaluations 
computed  at  some  randomly  chosen  points.  All  information  about  the  random  locations  at  which 
the  function  evaluation  were  computed  is  discarded.  We  have  shown  in  recent  research  that  using 
this  location  information  for  one-dimensional  integration  problems  can  improve  the  rate  of  conver¬ 
gence  from  rrm  to  nr1.  This  suggests  that  high-dimensional  Monte  Carlo  sampling  algorithms 
could  also  take  advantage  of  the  additional  function  evaluation  location  information. 

A  recent  trend  in  simulation  research  has  been  to  use  simulation  as  a  vehicle  for  system  optimiza¬ 
tion.  Suppose  a  system  can  be  described  in  terms  of  a  finite  set  of  parameters.  The  system  is  suf¬ 
ficiently  complex  that  its  performance  can  only  be  evaluated  via  simulation.  In  order  to  carry  out 
an  optimization  of  the  system  we  need  to  estimated  the  gradient  of  the  performance  measure  as  well 
as  its  value.  Two  methods  that  have  been  proposed  for  gradient  estimation  are  the  likelihood  ration 
and  perturbation  analysis  techniques.  Recent  research  has  developed  conditions  under  which  these 
two  techniques  are  valid. 

Stochastic  differential  equations  are  used  to  model  many  types  of  economic  and  physical  systems. 
Often  these  equations  cannot  be  solved  analytically  and  simulation  is  used  to  estimate  the  solution. 
When  simulation  is  used,  the  (continuous)  time  variable  is  discretized.  When  a  fixed  budget  for 
computer  time  is  available,  the  simulator  must  trade  off  the  size  of  the  discrete  time  step  and  the 
number  of  replications  that  can  be  made.  This  trade-off  is  resolved  for  both  first-order  discretiza¬ 
tion  schemes  (such  as  Euler)  and  second-order  and  higher  schemes  (such  as  those  of  Milshtein  and 
Talay). 


Diagram  1 .  Technical  Approach  to  System  Simulation* 
*Our  emphasis  is  on  the  shaded  boxes 
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